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Abstract 

Introduction:^^ application of health economic evaluation (HEE) evidence can play an important role in strategic planning 
and policy making. This study aimed to assess the scope and quality of existing research, with the goal of elucidating 
implications for improving the use of HEE evidence in Vietnam. 

Methods: A comprehensive search strategy was developed to search medical online databases (Medline, Google Scholar, 
and Vietnam Medical Databases) to select all types of HEE studies except cost-only analyses. Two researchers assessed the 
quality of selected studies using the Quality of Health Economic Studies (QHES) instrument. 

Results: We selected 26 studies, including 6 published in Vietnam. The majority of these studies focused on infectious 
diseases (14 studies), with HIV being the most common topic (5 studies). Most papers were cost-effectiveness studies that 
measured health outcomes using DALY units. Using QHES, we found that the overall quality of HEE studies published 
internationally was much higher (mean score 88.7+13.3) than that of those published in Vietnam (mean score 67.3+22.9). 
Lack of costing perspectives, reliable data sources and sensitivity analysis were the main shortcomings of the reviewed 
studies. 

Conclusion: This review indicates that HEE studies published in Vietnam are limited in scope and number, as well as by 
several important technical errors or omissions. It is necessary to formalize the process of health economic research in 
Vietnam and to institutionalize the links between researchers and policy-makers. Additionally, the quality of HEE should be 
enhanced through education about research techniques, and the implementation of standard HEE guidelines. 
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Introduction 

Health economic research has been increasingly utilized over 
the past few decades, particularly in developed countries, in order 
to improve the efficiency of healthcare spending. Health 
interventions, particularly medical technology and pharmaceuti- 
cals, are enormously expensive, and thus many countries have 
implemented formal health economic evaluation processes, such as 
Health Technology Assessments (HTA), as a standard tool for 
selecting and implementing interventions [6,37]. However, despite 
the greater gap between resources and need in developing 
countries, these countries lag far behind in the production of 
health economic research and the translation of research findings 
into health care policies [1]. 

Vietnam is a country that has yet to formalize a health 
economic evaluation system, although its healthcare system faces 
rising costs and dwindling resources. Since the market-oriented 
reforms of the 1980s, hospitals in Vietnam have turned to 



privatization, including the introduction of user fees and private 
hospitals, clinics, and pharmacies [1]. As has been observed in 
several other countries, including South Korea, Taiwan, and 
China, this fee-for-service system often leads to inefficiency and 
waste, as it incentivizes medical practitioners to overprescribe 
drugs and technology. Additionally, Vietnam's healthcare spend- 
ing is likely to increase, as its disease burden has shifted away from 
infectious diseases to more chronic, non-communicable diseases, 
which are often much more expensive to treat. Despite the 
introduction of social insurance to help offset the cost of 
healthcare, today 70-80% of financing for health services come 
from out-of-pocket (OOP) payments [1]. Moreover, while 
healthcare spending has been supplemented by foreign aid, this 
funding is starting to decrease, as Vietnam has just reached the 
lower middle-income level. It is, therefore, very necessary for the 
health sector to implement effective measures toward a sustainable 
and highly efficient health care system. 
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Several countries in Southeast Asia, including Thailand, 
Malaysia, and Taiwan, have established a Health Technology 
Assessment process in order to use healthcare resources more 
efficiently [35,36]. HTA provides evidence on consequences of 
polices on health technologies by reviewing and assessing their 
safety, efficacy, patient-reported outcomes, cost-effectiveness, and 
social, legal, ethical and political impacts. However, despite the 
potential of HTA in reducing healthcare spending, the use of 
health economic research in policy is often constrained by several 
factors, including lack of communication between researchers and 
policy-makers, research that is irrelevant to policy-makers, and 
poor study quality. With this in mind, this paper seeks to explore 
the scope and quality of health economic evaluation (HEE) studies 
that currently exist about Vietnam, in order to better understand 
what research is available for such resource allocation decisions 
and how it can be strengthened. We did this by conducting a 
systematic review of all HEE studies published about Vietnam, 
both within the country and internationally. By analyzing the 
strengths and shortcomings of existing health economic evidence, 
we recommend potential areas of improvement in the field of 
health economic research in Vietnam. 

Materials and Methods 

Search strategy and data sources 

A comprehensive search strategy was developed to search for 
published health economic evaluation studies about Vietnam. The 
systematic search was performed in March 20 1 3 and included all 
results up to 2013. For English published articles, we searched 
Medline and Google Scholar with combination of free-text 
keywords, including "cost", "economic", "expenditure," and 
"Vietnam". For Vietnamese published studies, we searched 
through a variety of Vietnamese medical databases, including 
the Vietnam Central Medical Library (VCML), the Hanoi 
Medical University Library, the Hanoi School of Public Health 
Library, the Hanoi University of Pharmacy Library, and the 
Health Strategy and Policy Institute Databases. The VCML was 
particularly useful, as it is the biggest database center of the 
Vietnamese official national medical database, managed by the 
Ministry of Health. (The search terms used are shown in 
Table 1). 



Table 1. Search strategy. 





Data sources 


Keywords 


PubMed 


(((((((((cost) OR costing) OR financial) 

OR economic) OR policy) OR cost-effectiveness) 

OR cost utility) OR cost benefit) OR cost minimization) 

AND Vietnam 


Google Scholar 
and Google.com 


"cost effectiveness" or "cost utility" or 
"cost benefit" or "cost minimization" 
and "Vietnam" 


Vietnamese 
data 


"chi phi" hoac "tai chfnh" hoac "kinh te" 
hoac "chi phi'-hieu qua" hoac "chi phf-lgi fch" 
hoac "chi phi - thoa dung" 



Vietnamese The Vietnam Central Medical Library 

database The Hanoi Medical University Library 

The Hanoi School of Public Health Library 
The Hanoi University of Pharmacy Library 
The Health Strategy and Policy Institute Databases 
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Study selection and inclusion/exclusion criteria 

Two researchers independently selected the studies for review 
via a two-stage screening process. First, the titles and abstracts of 
all the initial search results were reviewed. Based on the titles and 
abstracts, potentially relevant articles were selected for further 
review, which involved examining the content of their full text. All 
types of health economic evaluations that analyzed costs and 
consequences of one or more interventions were eligible for 
inclusion in the study, including cost-effectiveness, cost-utility, 
cost-benefit, and cost-minimization analyses. Cost-only analyses 
were excluded. In addition, we screened reference lists and 
contacted authors of selected studies for more potential papers. To 
avoid publication bias, we contacted all Vietnamese and 
international researchers who were active in health economics 
research in Vietnam to inform them the review and ask them if 
there is any study their institution has done or they were involved 
that falls into the scope of the review. In addition, we search 
purposively HEE studies in Vietnam using search engine such as 
Google.com. Besides, we used a standardized tool for data 
extraction and study quality assessment to avoid missing in 
reporting the content of the selected studies. The complete 
inclusion/exclusion criteria are shown in Table 2. 

Data extraction 

We developed a standardized extraction form to collect data 
from all eligible studies. Data extraction was performed by the first 
researcher (N.M.V) and verified by the second researcher (B.X.T). 
The data extraction form was divided into three sections: general 
information, study details, and results & findings. 

Quality appraisal 

The quality of selected studies was assessed and graded using 
the Quality of Health Economic Studies (QHES) instrument. The 
QHES has been proven to be a simple, consistent and suitable 
scale to measure the quality of health economic evaluation studies, 
especially cost-effectiveness studies [3]. It consists of 16 criteria in 
the form of "yes or no" questions that were selected by 8 experts in 
health economics [4]. Each question has a weighted point value 
ranging from 1-9, which are used to generate a summary score 
from 0-100 [4]. This QHES tool was used by two independent 
researchers to rate the quality of the selected studies. Since no 
standardized interpretation of the QHES exists, we set a score of 
75 to 90 as good quality and a score of 90 and above as excellent 
quality. 



Table 2. Inclusion/Exclusion criteria. 



Inclusion Exclusion 



• Full health economic evaluations: 


• Cost analysis studies, not 


comparing both costs and 


comparing costs and outcomes 


outcomes 


of interventions 


of two or more interventions. 




• Partial economic evaluations: 


• Not economic evaluation studies, 


analyzed costs and outcomes 


incl. impact, financial, or health 


of one intervention 


expenditure studies 


• Data not from Vietnam 


• Not published in English or Vietnamese 


doi:10.1371/journal.pone.0103825.t002 
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Figure 1. PRISMA flow chart of study selection. 

doi:10.1371/journal.pone.0103825.g001 

Data analysis 

Descriptive statistical analysis, including frequency and per- 
centages, was used to describe the characteristics of the studies. 
Health outcomes were measured by incremental cost-effectiveness 
ratio (ICER): cost per life year saved, cost per case averted, cost 
per DALY (disability-adjusted life year), and cost per QALY 
(quality-adjusted life year). These costs were adjusted for inflation 
as measured by the 2012 World Bank Consumer Price Index 
(CPI). Studies which reported cost in Vietnamese Dong were 
converted to US Dollar at the year of research. 

The WHO Guide to Cost-Effectiveness Analysis (WHO- 
CHOICE) categorizes interventions as "highly cost effective" 
when the ICER (measured as cost per DALY averted) is less than 



GDP per capita, "cost-effective" when the ICER is between one 
and three times GDP per capita, and "not cost-effective" when the 
ICER is more than three times higher than GDP per capita [5]. 
Following this guideline, we assessed the cost-effectiveness of 
interventions included in the selected studies by comparing their 
reported ICERs with GDP per capita in Vietnam, which in 2012 
was approximately 1,500 USD. 

Results 

Search results 

We conducted a search of potential articles through MedLine, 
Google Scholar, and a variety of Vietnamese databases. After 



PLOS ONE | www.plosone.org 



3 



August 2014 | Volume 9 | Issue 8 | e103825 



Review of Health Economic Evaluation Studies in Vietnam 



Table 3. Classification of studies by disease type studied. 



Type of diseases 




N 


% 


Infectious 
diseases 


HIV 


5 


19.23 




Hepatitis 


2 


7.69 




Diarrhea 


2 


7.69 




Malaria 


^^^^^^^^^^^^^^ 


3.85 




Typhoid 


1 


3.85 




Encephalitis 


^^^^^^^^^^^^^^ 


3.85 




Liver fluke 


1 


3.85 




Others 




3.85 


Maii-Iht Art ifii i c 
Hull IIHcLllUUa 

diseases 




4 


1 5 38 




Smoking 


2 


7.69 




Exsanguinate 


2 


7.69 




Reproduction 


1 


3.85 




Cardiovascular disease 


1 


3.85 




Mental Health 


1 


3.85 




Cerebral hemorrhage 


1 


3.85 
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identifying a large number of potential articles using key search 
terms, we used a two-stage screening process to select 26 papers for 
inclusion (see PRISMA flowchart in Figure 1). A total of 882 
articles were identified in the initial search, including 758 results 
from MedLine, 52 results from Google Scholar and 72 results from 
several Vietnamese databases. By applying the inclusion/ exclusion 
criteria for titles and abstracts in the first stage screening, 780 
articles were excluded. We reviewed 102 full-text papers at the 
second stage and rejected an additional 76 studies. After this 
screening process, we were left with 26 studies to analyze in this 
review [10-34,38], including 20 published internationally [10- 
28,38] and 6 published in Vietnam [29-34] . A total of 1 2 papers 
were written by Vietnamese corresponding authors. Most articles 
excluded from this review were either not health economic 
evaluations or did not use data from Vietnam. (See Table SI for 
profile of selected studies). 

Scope of health economic evaluation studies in Vietnam 

The studies were analyzed for the type of diseases they 
evaluated (Table 3). More papers presented research about 
infectious diseases (14 studies) than non-infectious diseases (12 
studies). Among studies about infectious diseases, the most 
common topic was HIV (5 studies), while a high percentage of 
the non-infectious disease papers focused on cancer (4 studies). 

The scope, methods and measures of selected studies are shown 
in Table 4. We found that the majority of health economic 
evaluation studies in Vietnam were cost-effectiveness analysis 
studies, 12 of which reported ICER by DALY/QALY units. In 
contrast, we identified only one cost-benefit study. The type of 
interventions evaluated included both treatment (n = 9) and 
prevention (n = 1 4) interventions, although only three studies 
evaluated both types in one paper. Most of the studies calculated 
costs from the perspective of the health care system (n = 11), while 
7 studies examined costs from the perspective of society; only 1 
study estimated cost from the perspective of service users, and 1 



examined the perspective of third-party payers. Nine studies did 
not state the perspective of cost-effectiveness analysis at all. 

The common costing approaches were bottom-up (n = 9), 
activity-based (n = 7), and top-down (n = 3). The majority of 
selected studies reported direct cost (n = 24), and only 8 studies 
considered the indirect cost. Sensitivity analysis was performed in 
76.92% studies (n = 20), and included one-way analysis (n = 13), 
multi-way analysis (n = 2), probabilistic analysis (n = 4), and 
bootstrap analysis (n = 1). In total, there was only 1 study that 
considered the budget impact, and only 1 study considered the 
suitability of ethics, politics, culture and society. 

The majority of selected studies (57.69%) used a 3% discount 
rate, and a plurality (30.77%) used a threshold of 3GDP. Of the 
studies that stated the use of a particular guideline, the majority 
followed the WHO-CHOICE guideline (23.08% of total papers), 
and 57.7% did not state the use of a guideline at all. 
Approximately half of the studies reported funding from an 
international source, of which the Bill and Melinda Gates 
foundation and Adantic Philanthropies were the most common 
funders. Only one study was funded by Vietnam Government, and 
46.2% of the studies did not state their source of funding. We 
estimated that nearly three quarters of corresponding authors were 
affiliated with a university, and only 19.23% were affiliated with 
the government. 

Cost-effectiveness 

We categorized all interventions analyzed in the studies as 
highly cost-effective, cost-effective, or not cost-effective, depending 
on how their ICERs compared to GDP per capita in Vietnam. 
The results of ICERs were shown in Figure 2, 3, 4, 5 (in these 
figures, we presented the cost which has been adjusted for 
inflation). While the results of the studies can obviously not be 
directly compared, given their differences in calculating and 
measuring ICERs, we found that most interventions were either 
highly cost-effective or cost-effective. Among the evaluated studies 
whose findings were reported in cost per life years saved or cost per 
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Figure 2. ICERs of studies reported health outcomes by cost per case averted. 

doi:1 0.1 371 /journal.pone.01 03825.g002 



case averted (Figure 2 and figure 3), seven interventions were 
highly cost-effective, with the ICERs ranging from $US 14.6 to 
$US 851, which is less than GDP per capita; 4 interventions were 
cost-effective, with ICERs ranging from $US 1670 to $US 2811, 
which is between one and three times GDP per capita. 



Among studies whose ICERs were measured as DALY or 
QALY units, we again found that the majority of the interventions 
analyzed were cost-effective or highly cost-effective (Figure 4 
and figure 5). Only one intervention-Typhoid V vaccine for 
children in Hue - was not cost-effective, with an ICER of 5303 



Oophorectomy and tamoxifen adjuvant therapy 
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Radiation treatment for brain tumors 



Removal of brain tumors 
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Figure 3. ICERs of studies reported health outcomes by cost per LYS. 
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Figure 4. ICERs of studies reporting health outcomes by cost per QALY. 

doi:10.1371/journal.pone.0103825.g004 



$US/DALY, which is more than three times higher than GDP per 
capita [22]. On the other hand, studies that analyzed methadone 
maintenance treatment (MMT) programs reported highly cost- 
effective results, on average 480$/ QALY gained. Similarly, of the 
papers reporting cost per DALY averted, more than half (9) of the 
studies reported highly cost-effective results, with ICERs ranging 
from 80 to 1480 $/DALY averted. 



Study Quality 

The quality of the evaluated studies was assessed by the Quality 
of Health Economic Studies instrument. These QHES scores are 
presented in Table 5. In total, 84.6% of the studies evaluated had 
good or excellent quality scores, and only 15.4% had low quality 
scores. Among studies conducted by Vietnamese researchers 
(n = 12), 33.3% of the studies were low quality, with a lowest score 
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Prevent cerebral hemorrhage using vitamin K 
Health education to prevent CDV 
ATK old generations + Family cognitive therapy 
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Figure 5. ICERs of studies reporting health outcomes by cost per DALY. 

doi:10.1371/journal.pone.0103825.g005 
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was 36. Only 4 studies written by Vietnamese authors had 
excellent-quality, and all of them were international published. On 
the other hand, among articles published by international authors, 
42.9% were good quality and 57.1% were excellent quality, with a 
highest score of 100 and no studies with a quality score of less than 
75. Finally, when categorized by publication source, 95% of 
papers published internationally were high or excellent quality 
compared to 50% of the papers published in Vietnam. These 
scores were generated based upon the studies' rating in response to 
16 "yes or no" questions (responses shown in Table 6). Overall, 
studies published by Vietnamese researchers had fewer positive 
responses to the QHES questions than international researchers. 
Indeed, there were two questions that Vietnamese researchers' 
studies had very low score (<50%): "Did the author(s) explicidy 
discuss direction and magnitude of potential biases?"(Q14) (42%), 
and "Was there a statement disclosing the source of funding for 
the study?"(QJ6) (8%). A low positive score (50%-60% of the 
studies) was seen in an additional two questions: "Were the 
perspectives of the analysis (societal, third-party payer, etc.) and 
reasons for its selection stated?"(Q2); "Were variable estimates 
used in the analysis from the best available source (i.e., 
randomized control trial-best, expert opinion-worst)?"(Q3). 

Among articles from international researchers, the majority of 
studies were scored favorably for the QHES criteria questions; 
more than 80% of these studies were evaluated as "Yes" for 13 of 
the 16 questions. The lowest scored question, with only 57% of the 
studies scored positively, was Q6, "Was incremental analysis 
performed between alternatives for resources and costs?" Ques- 
tions that were scored only moderately, with 70-75% of the studies 
scoring positively, were Q3, and Q5: "Were variable estimates 
used in the analysis from the best available source (i.e., 
randomized control trial-best, expert opinion-worst)?"; and 
"Was uncertainty handled by (1) statistical analysis to address 
random events, (2) sensitivity analysis to cover a range of 
assumptions? 

Discussion 

Health economic evaluation has been developed and increas- 
ingly implemented over the past few decades in order to support 
resource-allocation decisions. However, despite the limited fund- 
ing and growing healthcare spending needs in Vietnam, there has 
yet to be established a formal health economic evaluation process 
in this country, and very little research exists in this field. We 
identified only 26 health economic evaluations to include in this 
review, 20 published internationally and 6 published in Vietnam. 
Given the small number of papers, the topics they covered are 
obviously quite limited. A slight majority focused on infectious 
diseases, with HIV being the most common topic among them. It 
is interesting to compare this to the disease burden in Vietnam, 
where 56% of life years lost is due to non-communicable diseases 
and only 29% are due to communicable diseases (WHO Vietnam 
health profile). Indeed, 40% of mortality in Vietnam is due to 
cardiovascular disease, yet only one study included in this review 
examined this topic. 

The limited number and scope of the topics indicates that 
demands for health economic research to inform policy develop- 
ment remains limited. If the ultimate goal of health-economic 
evaluation is to support evidence-based policy decisions, then it is 
essential that the research being produced is of interest to the 
decision makers. This suggests the need for more institutional links 
between the producers (researchers) and end-users (policy-makers) 
of the research. Many countries, such as Thailand, Malaysia, 
South Korea, and Taiwan, have had success with this model, by 
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Table 6. Responses to QHES questions. 



QHES questions Positive response to QHES (%) 







International authors (int 


All 


Vietnam Corresponding authors 


journals) (n = 14) 




Int journals VN journals 






(n = 6) (n = 6) 


ALL (n = 12) 



1 Was the study objective presented in a clear, specific, 100 100 100 100 100 

and measurable manner? 



2 


Were the perspective of the analysis (societal, third- 65 
party payer, etc.) and reasons for its selection stated? 


83 


17 


50 


79 


3 


Were variable estimates used in the analysis from the65 
best available source (i.e., randomized control trial- 
best, expert opinion-worst)? 


83 


33 


58 


71 


4 


If estimates came from a subgroup analysis, were the96 
groups prespecified at the beginning of the study? 


100 


100 


100 


93 


5 


Was uncertainty handled by (1) statistical analysis to69 
address random events, (2) sensitivity analysis to 
cover a range of assumptions? 


83 


50 


67 


71 


6 


Was incremental analysis performed between 69 
alternatives for resources and costs? 


100 


67 


83 


57 


7 


Was the methodology for data abstraction (including96 
the value of health states and other benefits) stated? 


100 


83 


92 


100 


8 


Did the analytic horizon allow time for all relevant 100 
and important outcomes? Were benefits and costs 
that went beyond 1 year discounted (3% to 5%) and 
justification given for the discount rate? 


100 


100 


100 


100 


9 


Was the measurement of costs appropriate and the 88 
methodology for the estimation of quantities and 
unit costs clearly described? 


83 


67 


75 


100 


10 


Were the primary outcome measure(s) for the 96 
economic evaluation clearly stated and did they 
include the major short-term was justification given 
for the measures/scales used? 


83 


100 


92 


100 


11 


Were the health outcomes measures/scales valid and96 
reliable? If previously tested valid and reliable 
measures were not available, was justification given 
for the measures/scales used? 


83 


100 


92 


100 


12 


Were the economic model (including structure), 81 
study methods and analysis, and the components of 
the numerator and denominator displayed in a clear, 
transparent manner? 


67 


67 


67 


93 


13 


Were the choice of economic model, main 88 
assumptions, and limitations of the study stated and 
justified? 


83 


67 


75 


100 


14 


Did the author(s) explicitly discuss direction and 65 
magnitude of potential biases? 


83 


0 


42 


86 


15 


Were the conclusions/recommendations of the study100 
justified and based on the study results? 


100 


100 


100 


100 



16 Was there a statement disclosing the source of 54 17 0 8 93 

funding for the study? 
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requiring cost-effectiveness data in order for pharmaceutical 
products to be authorized for the local market, or to be eligible 
for reimbursement [35,36]. Even China, which does not have 
socialized health care like the previous examples, was actually the 
first country to implement such a formal process, as a means to 
efficiently utilize healthcare resources in a fee-for-service system 
that incentivizes doctors to overprescribe medicine and technology 
[35] . The important commonality of all these examples is that the 
demand for research comes from the policy-makers themselves, 
ensuring that the evidence produced is highly relevant to policy 
makers. While this study did not include any unpublished material, 



such as government documents, a formal process for cost- 
effectiveness analysis does not currently exist in Vietnam [35]. 

When we assessed the study quality, we found that the studies' 
quality was constrained by certain technical limitations, including 
lack of sensitivity analysis, using low-quality data sources, and 
failing to report things like funding sources, potential sources of 
bias, and the perspective of the cost analysis. These limitations are 
problematic in that they reduce the credibility of the research. 
This finding indicated that health economic research has some 
major technical limitations is reflected in other developing 
countries, including India, South Africa, and Nigeria [7—9]. 
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However, unlike these studies, which all found that papers 
authored by foreign authors had higher quality than those 
produced by local authors, we found that although the Vietnamese 
authored papers were generally of lower quality than the foreign 
authored papers, there was a greater difference in quality based on 
publishing location than on nationality of author. Papers published 
internationally and written by Vietnamese authors had an average 
quality score of 85.7, compared to a score of 90 for internationally 
published papers by foreign authors. 

On the one hand, this difference in quality based on publication 
location should be expected. Naturally, authors who produce 
papers of higher quality would be interested in publishing their 
papers in international journals. However, this finding highlights a 
couple of areas for concern. First, only 50% of the Vietnamese 
authors included in this study published in international journals, 
which suggests that barriers including language and research 
capacity may be inhibiting many Vietnamese authors from 
publishing in international journals. In order to ensure that 
Vietnamese researchers have the capacity to produce high quality 
health economic research, such research techniques should be 
incorporated into medical and public health education in 
Vietnam. 

Second, the fact that the bulk of high quality health economic 
research about Vietnam has been published internationally 
suggests that the target audience of this research is international, 
not domestic. Combined with the fact that of the 14 papers that 
reported funding information, 13 were funded by international 
sources, and only 1 by the Vietnamese government, this 
information calls into question whose interests are being addressed 
by the current research. In order for health economic research to 
have an impact on local policy decisions, it must be locally 
relevant, and if research about a country is too heavily dictated by 
foreign interests, the research produced may be less likely to align 
with the local political context and culture, and thus less likely to 
be relevant to policy makers [2]. This again suggests that there 
needs to be more institutional links between policy makers and 
researchers, so that in the future, the research produced can be 
more targeted to a local audience. 

In addition, the quality of the locally produced research should 
be improved, not only through improved research capacity, but 
also through enforcing the use research guidelines. Indeed, 100% 
of the papers published in Vietnam did not report using any HEE 
guidelines for their study. Many of the technical limitations that 
currently exist in many of the studies published in Vietnamese 
journals may be resolved if the studies had to comply to cost- 
effectiveness analysis guidelines. An example of successful imple- 
mentation of national guidelines for health economic research 
comes from South Korea, which allows industry to produce cost- 
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effectiveness research, but manages the quality and credibility of 
this research by issuing guidelines [36] . 

While this study used the QHES instrument, which has been 
found to be an accurate assessment of health economic study 
quality [4], it should be noted that this review paper may have 
some limitations. Since many Vietnamese databases are incom- 
plete, it is possible that some relevant Vietnamese studies were 
not included in the review. Additionally, some research may have 
been excluded due to publication bias itself, since studies with 
positive results are more likely to be published that those with 
negative results. Therefore, this review excluded from analysis 
many studies with negative results, or with too low of quality to 
be published. The scope of this review was limited to published, 
academic papers only, so much of the body of writing about 
healthcare in Vietnam - including press conferences, pharma- 
ceutical company announcements, and government reports - was 
not selected for review. Finally, the lack of clarity in many of the 
papers' descriptions of methodology and results may have 
impaired our process of classification and analysis. 

Conclusions 

In order to address the country's pressing healthcare needs, 
Vietnam must mobilize its limited resources as efficiendy as 
possible. Health economic evidence can play a key role in such 
decisions about resource allocation, however we identified several 
technical and institutional limitations with the current research. In 
order to improve the relevancy of research to policy-makers, 
Vietnam should implement a formal process of health economic 
research that involves communication between researchers, policy- 
makers, and health practitioners. Additionally, the quality of 
health economic research should be improved both through 
education and the implementation of research guidelines for 
national research. 
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